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ABSTRACT ^ \ ' ^ • , 

In the mid*1970*s ^t here' has. been phenomena^ gt^owth in 
the number of curricular progams offersdana subsequent enrollments 
of studeilts in the health pro'f essions. At the ^ame tiie,^ there is a 
growing discrepancy between the quantity of these programs and the- 
quality of the health care delivery system in the ffnite^ States. 
Policy in the health prof essionrs is ovsrly concerned ifith the numbers 
game, while the quality of training ^programs has goAe ulichallenged. 
Hedical faculty/ like others in higher education, generally receive • 
no traiiling es teachers dfiring their g£*aduate programs, ^ and are 
rewarded, primarily for their research productivity and professional 
statui^. lie must now focus ptimarily on the clarification of the . * 
goals of t'he country !s health care program and the immediate 
objectives of health trap.niiig programs. This policymaking process 
'shDuld include practitfoners^ professors, politicians, and the 
public. At tha moment, too much policy is being made and ^oo little 
evaluation undertaken in , health care education, management, a*nd 
delivery. (HSE) * J , * 



1 



0^ 



♦ Documents acquired by ERIC* includfe many informal unpublished 

♦ materials not available from other soarces. ERIC makes every effort 

♦ to "obtain the best copy available. Nevertheless, item« o? marginal 

♦ reproducitiility are often encountered aiid this jiffects the quality 

♦ of the microfiche and hardcopy reproductions' ERIC- makes avai,lat|Le 
via the. ERIC Document Reproduction Service (EDRS| . EDRS is not 

V responsible for thef^uflity of the original document. Reproductions, 

♦ supplied by EDBS are th^ .best' that can .be made from the original. 



POLICY AND EVA^UATl^N IN THE HEALTjH. PROFESSIONS 

Clare Hose and Glenn F. Ni^re 
Evaluation -and 'Training' In/titute 



Invited adaress -present e-j^ at z\\e Aspen BlosciLences Communication, 
Seminar^s ci' 197"'3> Asp^-en; Colorado, October 6-8 J 



VK.vXi\7 tne iaet -?r\erai years, there had[ been a phenomenal 

V • / 

grcv;th in tr:e nurr.bei- of^ curricular programs ot'fered and^ subsequent 
enrol l.l'-rnr s ji' srui-ni3 In xhe -health' prof e^slcr^s . At the cnr^tserj-t 

1':: alii 59 'jent al ' scncols in tr.- 
I:, \^ l^^:-A2 t' aaerxs ar)i additloncTi ' 

f:* planning 'c:nd d^evelcpment'. ^x>a::r.- 
^ I' j^: ^'...s -r^i^^ zr.-y-rl n^x^ses alone nar.cer over 1'53J5- 



: 'Lz^ Ai'^ J... . ^ 

/ 



Aau-^io tn^se :'i . e:3' cne * jfarge numbers of "paramedical anci^ 



1 a^xl.il-:'y personnel programs and the n^ime'rcus^ 
put lie - r*ealcr. prcr^rams enrolling individuals v,ho -wan^ zo becom^r 
•^piiemiologiats , nutri r i^ni-st ^ arid h:,-spital aaministra ::ur 3 , ana 




Unfortunately, at tht^ same time,,tnere is a growing discie- 

pancy Detween- the- quantity o: tnese programs and the qual'-iy cf 

tne healtn care aeliv^^r^ system in- the United States^ ^ _ L-<^3pite 

the fact that over $100' blllXon^was spent on persona'] healtn ^ 

9are 'in 1975 > mortality rates in the United States af-e still 

exces^^ively high. Certainly we^ha^e- made great progress' in many' 

'^reas , but tne quality of our health prof essi(;)nal3 and the eval- . 

♦ 

uatlon of their educational programs, ^till remain the most ne- 
git;ctea areac: -^^f heait:: rc-re policy. * . . 

Ut Ot^AtTMtNTOFMlAirtM. 
E0UCAT40N»W1LFA« , 
' ^ MATI0NALINSTITUT10I» 

* COUCATION 
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, .EDUCATION POSITION OR POLICY 



, The Sickness ' ' ' ' ^ ^ ^ 

\ . . 

Policy in the healtHk prof essions ig overly concerna^d 
with a number's game how many physicians and dentists are 
actively practicinig /in thfe U.S. today? How many will* be 
needed in year such and such? Hqw many medical and 'dental 
schools are currently Ir^^ existence? How many more will be 
needjfe by year 'SC and so? Other V®licy issues focus on the 
z supply of health manpov;er in primary care specj^alties such as 
. family pract ice ^ . internal medicine and pediatrics, and the 

geographic maldistribution of this manpov/er. 
' ^ Of c6urse-5 v/e must te concerned with the national supply 
of ne.alth professionals and their geographic distributioi^ ^ 
^Certainly we 'must: worK to increase the numbers of health pro- 
fessionals working in ghettos, barrios, rural an'd^-other under- 
/served areas of the country. These ^policy issues are the re- . 
• sponsibiTity of ^the government. But v/e must ais'o be concerned 
' about the qual-ity of. health care provided by these prof fssional::* 
and the quality of their education. This area of policy resides 
^ with our colleges and universities.. Ever since the first\iedi- 
cal school was established in 1767, the quality of health care 
in ^merica has been clos.ely linked „to the quality o^bprof essional 
health education. In the recent preoccupa^on with numbers, 
however, we have lost sight of ^our goals /and tne quality of our 
training programs has gone virtually unchallenged. It is time 
to shatter our illusions that these programs are top-notch and 
rattle the ivy covered walls that -hide the skeletons/ in th^ clini 
We must question the quality of instruct ion*^ in the^health pre 
fessioh^ as/weli as the effectiveness of the curricula. Tor ir^ 



our estimation, that quality ^'infinitely less than most 

people realize. > , ' ' * 

The Cause d ' • * * ^ " ^ ^ 

It not 'very difficult to diagnose the cause' of the 
instructional malady that pervades* our coll^^^s and^niver- 



sities. Like ali of tne other acadenic disciplines in higher' 
education, the hearth prof essions have clung , tenaciously to 
th$ t ifne-hor.cred shitboleth* that th^mere possession of an M,D, 
£?.D.3. or any other doctoral degree ^qualifies that person as 
a* teacher. In point o-f i'aot,' most medical faculty, like any 
othei' faculty, receive r.o training as teachers during their 
graduate programs. Like all faculty, healtn professional 
.faculty are rev/arded primarily for t'heir research productivity 
anc^^'their^ prafessional stature; few. are encouraged to, s 3' few 
devot^e significant portions of their time to upgrading t leir 
instructional skills or systematically evaluating '-the effective 
ness of their instruction. Hany acaept.'cert if icat ing boards as 
the ultimate tests of st.udent learning Whether or not the^e 
exams are really relevant to the goals of the health prdgr^am^ 
or the needs of the populat ioji Instructional programs .are too 
oft^n evaluated by students^, performance^ on examinations — if 
the grading curve is symmetrdcaliand bell-shapeti , the -course is 
regarded as successful.. The question oT how much benefit the 
course 'is to Improving the students ' ability to improve or 
maintain health ^in their' patients is rarely*, if ever asked. 



* Pew -schools have eiCpligit measurable goals defined 'for ^ 

* * ' ^ . • ** 

their programs and even fewer use -specific measurable in- 

structional objectives as a basi's for evaluating their, students 

learning. Soijie write ther.,, albeit' poorly, but very few us€% 

them'wiselyi Many faculty wno write, borrow .or buy them are 

not aware- that speci.flc measurable'-instruct ional objectives 

are but a part of a systemized le'arning approach called cri- 

t^erion-ref erenced instruction.- Th;e key word is measurable. 

Faculty are u^'ual^y unaware of the ctner ^ecessary components 

ft 

o'f tnis appr.cach ' — inc>lvidual student' assessment and feed- 
back, alternative 'methoas cf instruction and above all, 
evaluation .' Ccjeit?ves by themselves are worthless, yet 
volumes of-them are predominantly displayed at many schools 
and offered as evidence o.f, educational sophistication 'to 
accreditation teams which, to varying degrees assess th«i value 
of the programs by the number of objectives contained in them. 
The ailing' health of our' college 'and university prGrgT?ami6 c^n 
no longer be ignored.' Major surgery is in order. 
An Approaching Epidemic ' . ^ * 

^ At. least /or the hext few years, we miist step focusing 
inordinate ^amounts of attention on the question of how many 
Health professionals are 'needed irl wnat parts of the country** 
and -concern ourselves primarily with clarifying the goals of 
our country^s health care program and the imirtediate objective? 
of our health train ing ^. pr|bgr-amS : This policy making process 
should include practitioners, prof esac^rs , ppl^.ician^sJ^aaa.-tiie^_ 
public. . An eV^n more fundamental policy iss^ue concerns the 



health needs of the countrV and whether our' goals and. our 
training programs are really addressa^ t6 meeting these^^n-eeds . 
. • _ Let me give you art example' qf what l^ean., - Three years' ' ' ^ 
ago, we began working with a- dental school in California,- 
Assisting , in the process. of defining .explicit goaS-S, and ob- ^ ^ 
Jectives for the'Bchool-, departments and. courses as part qf ^ ^ 
'a 'comprehensive and long terpi program of curricular change 
and evaluation. During the goal-definition' period, \the faculty ^ \^ 
str.essed to us the importance of preventian, 'maintaining that 
if the focus of the program was -to train students in- the- pre- 
yention of disease as v/ell as Its treatment, many of the every- 
day ordinary dental diseasasj that plague our mouths Would • ^ 
eventually be eliminated,- lOne of the major school goals ulti- 
mately arrived at was that the students would be Wle to pro- 
vide effective preventive care in all areas of dental health. 

However*, when we examined the tourses to see' their relevanc-e 
to these school goals and qu^?%ioned both cur3^ent students and 
recent ^aduates of the program, we found that very little 
instructional attention was being devoted to th^ topic^ of pre- 
vention. It was, so'-to- speak-, "covered" in a single coiTrse in 



the sehior.year; few faculty in other courses ever -mefitiohed 

• ♦ 

the word. ^ It is stretching things a bit to expect that students 
would be overwhelmed ^ with- the importance of a topic and consider 
It critical to the health care of the public if it is discussed ' 
in only one course 'throughout a four-y.ecir program. That*'s just 
one of^'ihany examples 'of differences that^can 6e found bet^ween ,^ • 
intent' and actual practice in the- education of health professionals 



N^est anyone think that W;e. are p^intirjg' ati) overly t)re^k 

picture O'f" the situation, let me acl^owledge tti'e many pfo-; 

Je^sional schools ^t'h^t have tajfen steps to- improve their ed- - * ^ 

upational *programs in a nunber of areas. Some have added to - 
* ^ . * 

their staffs persons trained in, educat ional paycholo'gy/ learn- r 

^' • * • 

* in-g theory and" instructional techn'€)logy 'Others have avail- 

■ * • 

able to faculty -a num.ber 6f the most recent technological ad- 
vances in ins-true tional ecy^ipment. Unfortunately, hov/ever/in 

^a hur.l>er of these instances, bcth» the equipmerbt and the ^'expert s " 
'hie dormant.: Gome' of the most lonely and 'frustrated educators 

'we know^^.are surrounded by mag-nificent learning laboratories in 
dental and medical schools. They have not been able to get: th^ 
faculti^ to use it. In som^e ca-^es/'they forgot to show them hfow! 
And rarely have they decided whdt the^^coal ~of these educational 
experts or the technology should be. Too oftVn the:r^ is no' 
policy as, to tiow'the stijdents or the instructional program 

are to benefit. . . ' , - ' , 

' / • ' . ' ' ^ ' ' 

^ A numben of schools have become heavily iiavolved in com- , 

rfiunity health pr'ograms;' others harV-€~<ievelop6(i area health ed- 

uca?tiOn centers and other types of decentralized clin4cal-train-y^ 

ing programs. In many schools, -there is a new emphasis -oh the 
^ / « * * , ■ ^ 

early exposure of students to clinj.cal experiences" and a much^^ 

more conscibus effort^to relate basic science training t/S. clinical 

training. All of the,se efforts are to'Ue lauded. Still, even 

in many of these instances, the vji^eforms are uncoordinated and , 

institruted 'wj-thout benefit of a nee'ds assessment or clear ^e- ^ 



finition of purpose. Even worse, many are stainped successful 



regardless of whether the <ihanges were -ever systematically 
'evaluated for their educational impact. ^ * ' ' 



The Cure 



Policy making is by defini^tion s/t^W-ng a 'course to be 



followed in the. future. Evaluation is the formal assessment 
of the^effect or worth of -that action. The policy making pro- 



c6ss . transforms Inputs into outputs — th^ evaluation process 

IB concerned witVi the . qual^it yn of the output. Both-are, 
or at least should be, intimately related Evaluation- should 
be cch'tinuoas throughout the policy making process, preceding 
and anteceding the program/ and providing continuous infor-*" 
matiqn.for policy' reassessment arid progrcun improveme/it . A 
problem to be considered by this conference is that too much 
polic^^^ is being^made and too lit t le ^evaluation 1^ bein^ under- 
taken in the a'raa of health care education, management anl^ 
delivery. * . ^ 

Thq Compreh^n§iv^ Health Manpower 'Act of ^1971 ^provided 
tapitation grants and special projects grants to health pro- . 
fession sohootjs to encourage innovation and reform -parti- 
^cularly in ^the expansion ahd acceleration of the'ir programs. 
•Changing the direction of grants' from research to curricula, 
tHe^' t was a landmark, in Federal legislation and stimulate 
many new curricular -programs . But it is now five year^ later, 
less capitation funds are available, and the. time has come ^ to 
stop and reflect. Health professional schools must evaluate 
the effectiveness and impact of those expanded and accelerated 
programs. They -yiust evaluate the' relevance of thejprogramB to 
the goals of the nation's Wealth care program and^Blfey must 



evaluate the flexibility their a^ograms in r^etirig the *^ * ^ • 
needs of -an ever-changing population. ^ ^ 

Our 'social , systejr and its processes and programs are - , 
veTy complex phenomena/ and as- such, it is impossible, to 
always determine^ in 'adv^nde exactly what will 'occur as.a .'^T 
r^s^ult of our decisions 'or our Actions. Only tjy ^includihg ^ 
on-going, rigorous and - systematic fprmat^i.ve evaluation in 
the policy makirrs 'process c^n progr:afns be' modified or 
st]?ategi4s changed to meet the needs of a ^hanging ' popu- 
lation in a changing worid. Thes'e are .the crucial policy 
issuep that -must be addressed. The goal -of our ^ country ^ s 
h^al'.h care delivery system is to establish &nd maintain high 
standards of health ar.orig its citizens. ' That/goal can only 
be a'^,ccmplished If the quality . of the health care professionals, 
and nheir training is assured. As our schools go,' so go^es the ^ 

health oT tn^ nation. And only ^through evaluation can we 

' • . ' " ' . . 

determine the way in which our schools are .going. >• 



